Optimal Multi-Modes Switching Problem in Infinite Horizon
نویسنده
چکیده
This paper studies the problem of the deterministic version of the Verification Theorem for the optimal m-states switching in infinite horizon under Markovian framework with arbitrary switching cost functions. The problem is formulated as an extended impulse control problem and solved by means of probabilistic tools such as the Snell envelop of processes and reflected backward stochastic differential equations. A viscosity solutions approach is employed to carry out a fine analysis on the associated system of m variational inequalities with inter-connected obstacles. We show that the vector of value functions of the optimal problem is the unique viscosity solution to the system. This problem is in relation with the valuation of firms in a financial market. AMS Classification subjects: 60G40 ; 62P20 ; 91B99 ; 91B28 ; 35B37 ; 49L25.
منابع مشابه
Solving infinite horizon optimal control problems of nonlinear interconnected large-scale dynamic systems via a Haar wavelet collocation scheme
We consider an approximation scheme using Haar wavelets for solving a class of infinite horizon optimal control problems (OCP's) of nonlinear interconnected large-scale dynamic systems. A computational method based on Haar wavelets in the time-domain is proposed for solving the optimal control problem. Haar wavelets integral operational matrix and direct collocation method are utilized to find ...
متن کاملStochastic Optimal Multi-Modes Switching with a Viscosity Solution Approach
We consider the problem of optimal multi-modes switching in finite horizon, when the state of the system, including the switching cost functions are arbitrary (gij(t, x) ≥ 0). We show existence of the optimal strategy, and give when the optimal strategy is finite via a verification theorem. Finally, when the state of the system is a markov process, we show that the vector of value functions of ...
متن کاملOptimal switching decisions under stochastic volatility with fast mean reversion
We study infinite–horizon, optimal switching problems under a general class of stochastic volatility models that exhibit “fast” mean–reversion by using techniques from homogenisation theory. This leads to perturbation theory, providing closed–form approximations to the full switching problem which is often intractable, both analytically and numerically. We apply our general results to certain, ...
متن کاملAn Iterative Algorithm for the Optimal Control of Continuous–Time Switched Linear Systems
For continuous-time switched linear systems, this paper proposes an approach for solving infinite-horizon optimal control problems where the decision variables are the switching instants and the sequence of operating modes. The procedure iterates between a “master” procedure that finds an optimal switching sequence of modes, and a “slave” procedure that finds the optimal switching instants. The...
متن کاملOptimal Scheduling for Reference Tracking or State Regulation using Reinforcement Learning
The problem of optimal control of autonomous nonlinear switching systems with infinite-horizon cost functions, for the purpose of tracking a family of reference signals or regulation of the states, is investigated. A reinforcement learning scheme is presented which learns the solution and provides scheduling between the modes in a feedback form without enforcing a mode sequence or a number of s...
متن کامل